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Objectives 


We  have  developed  a  theory  of  control  bifurcations.  Loosely  speaking  a  con¬ 
trol  bifurcation  is  a  loss  of  linear  stabilizability  and  as  such  they  can  be  critical 
to  the  success  of  a  nonlinear  control  system. 

Status  of  Effort 


We  have  classified  all  control  bifurcations  through  codimension  two  and  have 
studied  how  they  can  be  stabilized  using  truly  nonlinear  feedbacks. 

Accomplishments/New  Finding 

The  concept  of  a  control  bifurcation  grew  out  an  AFOSR  PRET  project 
to  study  the  robust  stabilization  of  axial  flow  compressors.  Several  versions  of 
the  Moore  Greitzer  compressor  model  were  used  in  this  study.  McCaughan  [28] 
had  studied  the  classical  bifurcations  that  were  present  in  the  three  dimensional 
Moore  Greitzer  equations  (MG3)  [29]  as  the  throttle  and  other  parameters  were 
varied.  Liaw  and  Abed  [27]  considered  the  throttle  parameter  as  a  control  and 
developed  feedback  laws  to  change  the  criticality  of  the  primary  Hopf  bifurcation 
in  MG4.  We  realized  that  there  was  more  than  classical  bifurcations  in  these 
models,  there  was  a  new  type  of  bifurcation,  a  control  bifurcation.  With  this 
support  from  AFOSR  we  studied  such  bifurcations.  Our  efforts  have  stimulated 
other  workers  around  the  world  and  we  now  have  some  understanding  of  control 
bifurcations  in  low  co dimensions. 

A  clssical  bifurcation  can  occur  in  a  parameterized  family  of  differential  or 
difference  equations  as  the  parameter  is  varied.  Consider  the  equations 

x  =  f{x,n ) 

where  the  state  x  is  n  dimensional  and,  for  simplicity,  the  parameter  fi  is  one 
dimensional.  The  equilibria  x,  /i  are  the  solutions  of  the  equation 

0  =  f(x,fj,). 

This  is  n  +  1  equations  in  n  unknowns  so  typically  there  is  a  one  parameter 
family  of  equlibria  xe  =  xe(/i). 

Two  equilibria  are  topologically  equivalent  if  there  is  a  local  homeomorphism 
of  the  state  space  carrying  one  equlibrium  and  its  local  orbits  to  the  other  and 
its  local  orbits  while  preserving  the  time  direction  of  orbits  but  not  necessarily 
the  exact  time.  A  classical  bifurcation  occurs  at  an  equilbrium  which  is  not 
topologically  equivalent  to  its  neighboring  equilibria. 

The  linear  approximating  system  at  the  fj,th  equilbrium  in  displacement  co¬ 
ordinates  is 

z  =  F(fi)z 
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where  z  =  x  —  xe(fi)  and 


F(n)  =  |^(xe(/i),/x). 

The  usual  way  that  a  classical  bifurcation  occurs  is  that  one  or  more  eigenvalues 
of  F{fi)  cross  the  imaginary  axis  as  /i  is  varied.  To  determine  the  simple  ways 
that  this  can  occur,  one  uses  the  concept  smooth  equivalence  and  its  resulting 
Poincare  normal  forms.  Two  equilibria  are  smoothly  equivalent  if  there  is  a 
local  diffeomorphism  of  the  state  space  carrying  one  equlibrium  and  its  local 
orbits  to  the  other  and  its  local  orbits  preserving  the  exact  time.  The  normal 
forms  are  represntatives  of  the  resulting  equivalence  classes.  The  drawback  of 
using  smooth  equivalence  is  that  there  are  too  many  equivalence  classes.  So 
one  restricts  one  attention  to  smoooth  equivalence  of  the  lowest  degree  terms  in 
power  series  expansions  of  the  systems  about  teir  respective  equilibria.  A  degree 
d  normal  form  of  a  system  is  a  particularly  simple  system  which  is  smoothly 
equivalent  through  terms  of  degree  d.  The  normal  form  may  or  may  not  deter¬ 
mine  the  topolgical  type  of  the  equilibrium.  But  the  cases  where  it  does  not  are 
usually  of  higher  codimension  in  the  class  of  systems.  Arnold  and  Ilyashenko 
[15]  have  given  classification  of  all  singular  equilibria  in  codimensions  one  and 
two.  This  leads  to  a  classification  of  all  bifurcations  up  to  codimension  two  [16] 
by  adding  the  parameter  to  the  state  with  (i  =  0. 

A  control  system 


X  =  f(x,u), 

where  the  state  x  is  n  dimensional  and,  for  simplicity,  the  control  u  is  one 
dimensional,  does  not  need  a  parameter  to  bifurcate.  The  equilibria  x,  u  are  the 
solutions  of  the  equation 


0  =  f(x,u). 

Again  this  is  n-f*  1  equations  in  n  unknowns  so  typically  there  is  a  one  parameter 
family  of  equlibria  xe  =  xe(fi)  where  fi  is  the  set  value  of  the  control  or  of  a 
state. 

The  most  widely  used  equivalence  of  control  systems  is  smooth  feedback 
equivalance.  Two  control  systems  with  equilibria 

x  =  f  (x,  it) ,  0  =  f(xe)ue) 

z  =  9{z,v),  0  =  g(xe,ve) 

are  smoothly  feedback  equivalent  if  there  is  a  local  diffeomorphism 

z  =  4>(x) 

v  =  k(x,u) 

between  the  two  systems  at  the  equilibria. 
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This  is  too  fine  an  equivalence,  there  are  too  many  equivalence  classes.  We 
might  try  for  a  coarser  equivalence;  two  equilibria  are  closed  loop,  topologically 
equivalent  if  there  axe  continuous  feedbacks 

u  =  k(x) 

v  =  X(z) 

such  that  the  closed  loop  systems  are  topologically  equivalent. 

But  this  definition  is  not  an  equivalence  relation  (not  transitive)  and  it  ig¬ 
nores  the  most  important  systems  theoretic  property  of  an  equilibrium  of  a 
control  system,  whether  it  is  stabilizable  by  state  feedback.  Therefore  we  add 
the  requirement  that  the  feedbacks  locally  asymptotically  stabilize  the  systems. 

A  equilibrium  of  a  control  system  is  structurally  stabilizable  if  it  and  all 
nearby  equilibria  of  all  nearby  systems  are  locally  asymptotically  stabilizable 
by  continuous  feedbacks. 

A  control  system  is  locally  parameterically  stabilizable  at  xe(jjLc),ue(fjLc)  if 
there  exists  a  continuous,  parameterized  feedback 

u  =  k{x,p) 

defined  for  all  \l  near  /xc  and  x  near  ze(/xc)  which  locally,  asymptotically  stabi¬ 
lizes  the  system  to  xe{fi)  . 

A  control  bifurcation  [8]  occurs  at  an  equilibrium  xe,ue  which  is  not  locally 
parameterically  stabilizable. 

Perhaps  this  should  be  called  "stabilizability  bifurcation”  but  this  terminol¬ 
ogy  is  too  awkward. 

In  practice,  control  bifurcations  occur  when  the  linear  part  of  the  system 
loses  stabilizability.  But  this  is  not  always  true,  here  is  a  system  which  loses 
linear  stabilizability  but  does  not  experience  a  control  bifurcation, 

x  ~  —u2x  —  x 3 

where  x  €  JR,u  €  JR.  This  system  has  a  locus  of  equilibria  given  by  xe  =  0,  ue  = 
/x.  For  any  /x  /  0  the  equilibrium  is  linearly  stable  hence  linearly  stabilizable. 
At  /x  =  0  the  system  is  not  linearly  stabilizable  but  is  nonlinearly  stable  hence 
nonlinearly  stabilizable  so  there  is  no  control  bifurcation. 

On  the  other  hand,  a  system  can  experience  a  control  bifurcation  without  a 
change  in  its  linear  stabilizability,  here  is  an  example. 

x  =  x  +  xu 

where  x  e  JR^u  e  1R.  This  system  has  a  locus  of  equilibria  given  xe  =  0, ue  =  /x 
and  is  not  linearly  stabilizable  for  any  /x.  For  any  \i  <  —  1,  the  equilibrium  is 
stabilizable  by  the  feedback  u  —  /c(x,/x)  =  /x.  But  it  is  not  stabilizable  to  the 
equilibria  where  fi  >  —  1  so  it  undergoes  a  control  bifurcation  at  /x  =  —  1 . 

If  a  control  system  is  locally  parameterically  stabilizable  then  any  other 
system  that  is  smoothly  feedback  equivalent  to  it  is  also  locally  parameteri¬ 
cally  stabilizable.  We  have  developed  a  theory  of  normal  forms  (relative  to  the 


3 


smooth  feedback  group)  and  they  are  very  useful  in  classifying  the  simplest  ways 
a  control  bifurcation  can  happen  [22],  [23],  [24],  [8].  There  is  a  close  correspon¬ 
dence  between  the  simplest  classical  and  control  bifurcations.  Very  often  when 
the  loop  is  closed  around  a  system  with  a  control  bifurcation  the  result  is  an 
inevitable  classical  bifurcation  in  the  closed  loop  dynamics. 

We  have  classified  all  control  bifurcations  in  codimensions  one  and  two,  see 
[20],  [21],  [1],  [2],  [?],  [6],  [23],  [24],  [8],  [11],  [26].  The  complete  classification 
will  appear  in  [10] 

We  start  with  systems 

x  =  /(x,u) 

with  a  scalar  control  u.  The  simplest  control  bifurcation  is  the  fold  [8] .  It  is  the 
only  codimension  one  control  bifurcation.  Its  normal  form  is 

±i  =  axi  +7x1X21  +  Sxli  T  0(x,u)3 
±2  =  A2x2  +  B2u  +  0(x,  u )2 

where  x\  e  JR,  x2  e  JRn~l  Without  loss  of  generality,  we  can  assume  that 
A2,  B2  are  in  Brunovsky  form  and  a  >  0, 7  >  0, 6  >  0 

The  equilibria  of  this  system  can  be  parameterized  by  the  first  component 
x2i  of  x2  which  we  denote  by  /x.  Then  the  equilibria  near  /x  =  0  are  given  by 

*i(M)  =  ~^2  +  0(ti)3 

xn  (m)  =  H 

x2i{n)  =  0{n)2 ,  i  =  2,...,n  — 1 

u(fi)  =  O(n)2. 

The  linearization  around  nth  equilibrium  in  displacement  coordinates 
z  =  x  —  x(n)  v  =  u  —  u(p) 

is  given  by 


+  ([-^]+°M2) 


To  leading  order  in  /x  this  is  a  parameterized  family  of  linear  systems 

i  =  A(fi)z  +  Bv  +  0(/x)2 
whose  controllability  matrices  are 

[  An-'B...B  ]=  °  +0(/i)2. 
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Notice  that  the  determinant  of  the  controllability  matrix  changes  sign  at  fx  =  0. 
This  is  a  manifestation  of  the  control  bifurcation.  The  effect  of  the  integrated 
control  action  on  z\  reverses  direction  at  /i  =  0. 

Suppose  we  try  to  close  the  loop  by  a  continuous  parameterized  feedback 
u  =  k(x,  [i)  so  that  for  each  small  the  closed  loop  system 

X  =  f(x,K(x,n)) 

is  asymptotically  stable  to  x(/x). 

If  the  feedback  is  smooth  then  in  displacement  coordinates  it  takes  the  form 


v  =  Ki(fj)zi  +  K2{fi)z2  +  . . . . 

The  linear  part  of  the  resulting  closed  loop  system  at  the  fith  equilibrium  is 


i 


a  +  7// 

O 

O 

4- 

CNI 

[  b2k 1 

a2  +  b2k2  J 

and  so  the  closed  loop  system  undergoes  a  classical  fold  bifurcation  near  fi  =  0. 

The  next  simplest  bifurcation  is  of  codimension  two  and  is  called  the  trans- 
critical  control  bifurcation  [8].  It  is  also  called  the  transcontrollable  bifurcation. 
Its  normal  form  is 


Xi  =  fix\  +  ^XiX2\  +  Sx 2i  +  0(x:  u )3 
X2  =  ^2^2  +  B2u  +  0{x ,  u)2 

where  again  Xj,u  €  2R,  x2  6  JRn_1  and  A2,B2  are  in  Brunovsky  form.  It  can 
be  seen  as  a  degenerate  form  of  the  fold  control  bifurcation  where  a  =  0.  When 
a  =  0  there  is  an  extra  term  in  the  normal  form,  fix 2  that  cannot  be  eliminated 
by  the  feedback  group. 

The  generic  case  is  when  the  quadratic  form  fix2  +  7x1^21  +  Sx2i  is  nonde¬ 
generate.  If  this  form  is  sign  definite  then  x\  =  0,  x2  =  0,  u  =  0  is  an  isolated 
equilibrium.  If  it  takes  on  both  positive  and  negative  values  then  there  are  two 
curves  of  equilibria  crossing  at  x\  =  0,  x2  —  0,  u  =  0.  Each  of  these  curves  can 
be  parameterized  by  fi  =  x2\-  The  linearization  about  any  of  these  equilibria 
is  linearly  controllable  except  at  \x  —  0  where  the  curves  cross.  The  controlla¬ 
bility  matrix  changes  sign  at  jjl  —  0  on  each  branch  of  equilibria  which  is  the 
reason  that  this  is  called  a  transcontrollable  bifurcation.  If  we  again  try  to  find 
a  parameterized  feedback  u  =  K(r,/x)  so  that  for  each  small  (jl,  the  closed  loop 
system 

X  =  f{x,K(x,n)) 


is  asymptotically  stable  to  the  equilbria  on  one  branch  then  typically  there  is  a 
classical  transcritical  bifurcation  in  the  closed  loop  system. 

We  have  also  discovered  nonlinear  ways  of  stabilizing  these  bifurcations 
where  linear  methods  fail.  Both  the  fold  and  transcontrollable  bifurcations  can 
be  put  in  the  normal  form 

±1  =  axi+ fixl~\-^xix2i-\-8xlx-\-0(x,u)3 

x2  =  A2x2  +  B2u  -f  0(x ,  u )2 


<3 
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In  either  case  there  is  an  exchange  of  controllability  at  \i  =  0  so  we  choose  the 
piecewise  linear  feedback 

u  =  K1X1  +  K2X2 

where  Ki  =  Kf  as  ±x\  >  0  and  A2  +  B2K2  is  Hurwitz.  Then  the  x2  coordinate 
is  stable  in  the  first  approximation  so  we  need  only  worry  about  the  stability  of 
X\.  If  a  <  0  the  there  is  no  control  bifurcation  as  Zi  is  also  stable  in  the  first 
approximation  and  there  is  nothing  more  to  do,  we  can  set  Kf  =  0. 

If  a  >  0  then  there  is  a  control  bifurcation  and  we  must  choose  Kf  ap¬ 
propriately.  The  reduction  of  the  problem  of  stabilizing  the  overall  system  to 
that  of  stabilizing  a  small  number  of  coordinates,  in  this  case  one  coordinate, 
is  reminscent  of  how  the  center  manifold  theorem  is  used  to  reduce  the  study 
of  the  stability  of  an  equilibrium  of  a  higher  dimensional  ODE  to  the  study  of 
the  stability  of  the  dynamics  restricted  to  the  center  manifold.  With  support 
from  this  grant  we  have  developed  the  controlled  center  dynamics  technique  for 
stabilizing  the  linearly  unstabilizble  part  of  the  system. 

Following  [6]  and  [?],  we  seek  a  piecewise  smooth,  approximately  invariant 
manifold  of  the  form 


x2  =  L±x  1  +  0(x  1)2  = 


xi  +0(rri)2 


for  the  closed  loop  dynamics.  The  approximately  invariant  manifold  assumption 
is  that 

-X2  =  L±-x1+°(xf 

or  equivalently 

(A2  +  B2K2)  L±x  1  +  B2Kfx  1  =  ax  1. 

This  reduces  to 

Kf  =  Lfp2(a),  Lf  =  Lfai~\  i  =  2,...,n-l 


where  P2(s)  is  the  characteristic  polynomial  of  the  Hurwitz  matrix  A2  +  B2K2. 
Since  a  >  0,  P2(«)  7^  0  so  we  can  parameterize  the  first  part  of  the  feedback  by 
Lf  instead  of  K±. 

The  dynamics  on  this  manifold  is 

±1  —  axx  +  {fi  +  7 Lf  +  S(Lf  )2)  x\  +  0(x )3 

First  we  consider  the  transcontrol lable  bifurcation  where  a  =  0.  By  assumption 
the  quadratic  /3  -f  *yLf  +  S(Lf)2  takes  on  both  positive  and  negative  values  as 
Lf  varies.  So  we  choose  Lf  so  that 

±{/3  +  'yLt+8(Lt)i)<  0 

and  we  have  locally  stabilized  x\.  The  stability  of  the  overall  system  follows 
from  Lyapunov  arguments. 
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For  a  fold  control  bifurcation  where  a  >  0,  we  certainly  cannot  achieve 
asymptotic  stability.  But  if  a  is  small  enough  we  can  achieve  practical  stabil¬ 
ity.  Without  loss  of  generality,  (5  =  0.  We  choose  small  L+  so  that  ax\  + 
(7L+  +  <5(L+)2)  x\  has  a  small  positive  root  x+.  Then  this  is  a  locally  stable 
equilbrium.  Similarly  we  choose  small  L]~  so  that  ax\  +  (7^1  +  ^(^i)2)^i 
has  a  small  negative  root  xj”.  This  is  also  a  locally  stable  equilbrium  and  so 
locally  X\  goes  to  either  xf .  This  is  called  practical  stabiliz ability  as  we  can 
choose  to  make  these  two  stable  equilibria  xf  close  to  x\  =  0.  We  have  not 
stabilized  to  x\  —  0,  this  is  impossible  as  a  >  0,  but  we  have  stabilized  to  a 
small  neighborhood  of  it,  [x]",Xi“].  Again  the  practical  stability  of  the  overall 
system  follows  from  Lyapunov  arguments  [6]. 

The  above  analysis  analogous  to  the  stability  analysis  of  an  equilibrium  of  an 
ODE  using  the  center  manifold  theorem.  The  method  of  the  controlled  center 
dynmaics  is  a  way  for  stabilizing  (or  practically  stabilizing)  a  control  system 
that  are  not  linearly  stabilizable.  First  one  uses  linear  feedback  to  stabilize  the 
linearly  controllable  modes  and  then  one  uses  invariant  manifold  techniques  to 
study  the  stabilizability  of  the  reduced  system  consisting  of  the  linearly  unstable 
and  uncontrollable  modes. 

The  fold  is  the  only  codimension  one  control  bifurcation  of  a  scalar  input 
system.  The  transcontrollable  bifurcation  is  of  codimension  two.  The  other 
control  bifurcations  of  codimension  two  are  as  follows. 

For  a  scalar  input  system  there  are  two  and  they  both  involve  a  system  with 
two  linearly  unstabilizable  modes  at  some  critical  equilibrium.  They  differ  in  the 
linear  part  of  the  unstabilizable  modes.  The  first  has  two  real,  distinct  positive 
eigenvaues  and  second  has  a  complex  conjugate  pair  of  eigenvalues  with  positive 
real  part.  The  latter  is  sometimes  called  the  Hopf  control  bifurcation  [8]  but 
perhaps  this  term  should  be  reserved  for  the  codimension  three  case  when  the 
real  parts  of  the  eigenvalues  are  zero. 

Other  higher  codimension  control  bifurcations  of  scalar  input  systems  are 
where  one  or  both  of  the  real  uncontrollable  eigenvalues  are  zero  and  where 
the  eigenvalues  of  the  uncontrollable  linear  part  are  the  same  and  its  Jordan 
form  is  not  diagonal.  Even  higher  codimension  cases  include  the  case  where  the 
eigenvalues  of  the  uncontrollable  linear  part  are  the  same  and  its  Jordan  form 
is  diagonal  and  where  the  eigenvalues  are  zero. 

There  is  one  codimension  two  control  bifurcation  of  multi- input  systems.  It 
is  a  double  fold. 

If  there  is  more  than  one  input  then  a  control  bifurcation  usually  takes 
place  at  an  equilibrium  where  the  controllablity  (Kronecker)  indices  change. 
For  example  if  the  dimension  of  the  state  is  n  =  2k  and  the  dimension  of 
the  control  is  m  =  2  then  generically  the  controllability  indices  are  {/c,  k}.  A 
codimension  one  control  bifurcation  takes  place  when  the  controllability  indices 
become  l>k  -  1}. 
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